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Abstract 

We analyze a specific role of probability density gradients in the theory of irreversible transport 
processes. The classic Fisher information and information entropy production concepts are found to 
be intrinsically entangled with the very notion of the Markovian diffusion process and that of the 
related (local) momentum conservation law. 

1 Motivations and associations 

The main objective of the present paper is to analyze the role - origins, possible physical 
meaning and manifestations - of two analytical expressions which are omnipresent, directly 
or indirectly, in any theoretical framework addressing an issue of transport driven by 
Markovian diffusion processes. Both derive from the sole properties, and specifically the 
time evolution, of the probability density associated with the analyzed stochastic process 
(like e.g. the dynamics of tracer particles in a gas or fluid). 

Let us specify the context by considering spatial Markov diffusion processes with a 
diffusion parameter (constant or time-dependent) D and generally space-time inhomoge- 
neous probability density p. 

One of the aforementioned expressions reads: 



,1/2 



Q = 2D^ = D 2 



^tt'+DV-tt (1) 



where u = DV lnp is sometimes named an osmotic velocity field. 

Density gradients are here explicitly involved and it is useful to invoke at this point 
a vivid discussion, carried out recently, about the status of density gradient as a "real" 
(thermodynamic) force performing work on the particles and the related issue of the local 
irreversible entropy production, see e.g. 0-0, see however also 

Let us recall that the standard spatial Brownian motion involves v — — u , known 
as the diffusion current velocity and (up to a dimensional factor) identified with the 
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"thermodynamic force of diffusion" [Hj which drives the irreversible process of matter 
exchange at the macroscopic level. In terms of tracer particles, this irreversible process 
occurs even if they are so dilute that they never meet (nor interact with) each other. 

On the other hand, even while the "thermodynamic force" is a concept of purely 
statistical origin associated with a collection of particles, in contrast to microscopic forces 
which have a direct impact on individual particles themselves, it is well known 00 El that 
this force manifests itself as a Newtonian-type entry in local conservation laws describing 
the momentum balance: in fact that pertains to the average (local averages) momentum 
taken over by the "particle cloud", a statistical ensemble property quantified in terms of 
the probability distribution at hand. It is precisely the (negative) gradient of the above 
potential Q, Eq. (1), which plays the Newtonian force role in the momentum balance 
equations, [Old- 

To elucidate the role of the second analytical expression of interest in our present 
considerations (Q was actually the first) let us observe that in one space dimension, for 
probability densities vanishing at spatial infinities, we have: 

Qpdx = J -pdx = -D 2 ■ F x (2) 

where Fx is the so-called Fisher information [TU1 ITT1 IT2"] of (encoded in) the probability 
density p which quantifies its "gradient content" (sharpness plus localization/disorder 
properties) and reads: 

(Vp) 2 



F x = / ^-^dx . (3) 
J P 

An important property of the Fisher information (stemming from the Cramer-Rao 
inequality in the statistical inference theory, [TU]-[14|) is that F^ 1 sets the lower bound 
for the variance of the random variable X(t) with values in R , distributed according to 
p(x,t): 

<X 2 )-(X) 2 >F X 1 . (4) 

On the other hand, in direct correspondence with our previous discussion of Q(x, t), let 
us point out that the integrand in Eq.(3), up to a dimensional factor, defines the so-called 
local entropy production inside the system sustaining an irreversible process of diffusion, 
[HE]. Accordingly, 0IH 

™ =D .[m dx=D . Fx>0 (5) 

at J p 

stands for an entropy production rate when the Fick law-induced diffusion current (stan- 
dard Brownian motion case) j = —DVp, obeying d t p + Vj = 0, enters the scene. Here 
S = — J pin pdx plays the role of the (time-dependent) information entropy in the 
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nonequilibrium statistical mechanics framework for the thermodynamics of irreversible 
processes. It is rather clear that the high rate of the entropy increase corresponds to a 
rapid spreading (flattening down) of the probability density. That explicitly depends on 
the "sharpness " of density gradients. 

The potential-type function Q(x, t), the Fisher information Fx(t), nonequilibrium mea- 
sure of the entropy production dS/dt and the information entropy S(t) are thus mutually 
entangled quantities, each being exclusively determined in terms of the probability density 
p(x, t) and its spatial derivatives. 

2 Hydrodynamical (local) momentum conservation laws - the 
zoo 

As mentioned before, the function Q(x, t) notoriously appears in various local conservation 
laws responsible for the momentum balance in suitable physical systems. Let us make a 
brief perusal of the respective partial differential equations. 

In the standard statistical mechanics setting, the Euler equation does not refer to any 
Q, Eq. (1), but deserves reproduction for the obvious comparison purpose as a prototype 
momentum balance equation in the (local) mean: 

-> ~F VP 

(d t + ^-V)^ = (6) 

m p 

where we generally assume F = — W to represent the "normal" Newtonian force. 

With regard to the manifest appearance of Q, we begin from an encounter with V Q 
in an out-of-statistical mechanics example provided by the hydrodynamical formalism of 
quantum theory, [To"] : 

& + V)V = —F - VQ q = —F + (7) 

where Q q = — A ^/ 2 is the familiar de Broglie - Bohm quantum potential. 

Another spectacular example pertains to the standard free Brownian motion in the 
strong friction (Smoluchowski diffusion) regime. Namely, we have, 

(d t + lT- V)^ = -2D 2 V-^- = -VQ (8) 

where 1? = —D^y\ D is the diffusion constant (set formally D = H/2m and notice the 
sign change in comparison with the previous quantum mechanical law). 

The large friction (Smoluchowski again) limit of the driven phase-space random dy- 
namics implies, [7j: 

(d t + l?-V)l? = V(fi-Q) (9) 
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where ~v = ~v(Jc,t) = — D^y-, the volume force (notice the positive sign) reads 
+ Vf2 instead of the previous — VV. Here Q = 2D 2 A ^ 1 / 2 and (recall the spectral analysis 
of Fokker-Planck operators, cf. [7]) 

For a class of "perverse" diffusion processes (respecting the so-called "Brownian recoil 
principle", [Zj), we deal with Markovian diffusion processes with the inverted sign of 
V (f2 — Q) in the local momentum conservation law, so that the previous Eq. (9) takes 
the form: 

(d t + l?-V)V = V(Q-fi) (11) 

By introducing ip = p l l 2 exp(iS) and ~u = 2DV S, we set a link with the "true" (notice 
an imaginary unit i) Schrodinger-type dynamics: 

Q 

id t ip = —DAip + — — i) 
2mV 

Useful observation: the total energy j Ri {-\ Q + &)pd?x = j R z{\- + \- + Q)pd 3 x of 

the system is a conserved finite quantity. Here u(x,t) = DV In p(x ,t). Notice that 
(D/2)dS/dt of Eq.(5), makes an explicit contribution to an overall energy of the system. 

The conservation of the total energy tells that the entropy production and the kinetic 
energy due to diffusion currents stay in competition. 

For a special case of the frictionless random phase-space dynamics, [H], we arrive at: 



d t + ~v • V 



— + 2d\t) V 
m 



Ap 



1/2 



pl/2 



'12) 



where F denotes the external force acting on the particle, and d(t) is the time-dependent 
diffusion parameter. This form of the law has been derived by explicitly solving the 
Fokker-Kramers equation with properly adjusted (gaussian densities) initial data, for the 
following cases: 

1. free particle: F = 0, n = 1 

2. charged particle in a constant magnetic field: F = elj x B , n = 2 

3. harmonically bound particle: F = —muj 2 x, n = 1 

Presumably this form is universal (no general proof at the moment). The coefficient 
d 2 (t) in all those cases can be represented as a product of variances (n=l) evaluated with 
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respect to conditioned phase-space w x (u,t) = ^."'^ and configuration space (marginal) 
p(x,t) — f f (x, u, t) du densities respectively: 

d*(t) = {{u>) x -{u)l){{x*)-{xf) (13) 

One may prove that d 2 (t) is bounded from below which results in the Heisenberg-type 
inequality for variances: of U(t) with respect to the conditioned phase-space density 
w x (u,t), and X(t) with respect to the marginal density p(x,t). 

3 Diffusion processes and differential equations - pedestrian rea- 
soning 

Let us sketch how the previous observations come out within the traditional setting of 
phase-space stochastic processes. 

3.1 Standard Brownian motion 

Let us consider the competition between deterministic/random driving and friction in the 
standard Brownian motion: 

-& = * ^ (14) 

where (A; (s)) = and (At (s) Aj (s')> = 2g5 (s - s 1 ) F = -VV. 

For the case of the standard Brownian motion, we know a priori, in view of the 
fluctuation-dissipation theorem, that q = Df3 2 where D — while (5 is given by the 
Stokes formula m/3 = 6nr]a. 

The resulting (Markov) phase - space diffusion process is determined by solutions of 
the Kramers equation: an initially given f(xo, Uo,to) is propagated according to: 

dt + H ■ + £ • j / = C(/) = (gV^ + 01? • V^) / (16) 

Here we adopt the kinetic theory notation for a substitute of collision term, where 
/ C{f)d 3 u = 0, while i / ~uC(f)d 3 u = -(31?(-x, t). 

Accordingly, the continuity equation holds true for the marginal (spatial) probability 
density p = J fd 3 u and ~v = ~ p j ~u fd 3 u. That has a devastating effect on the form of 
the corresponding momentum conservation law in the large friction regime. 

The associated Smoluchowski process with a forward drift b (~x) = ^ is analyzed 
in terms of the normalized Wiener process W(t): the infinitesimal increment of the con- 
figuration (position) random variable X(t) reads: dX (t) = -j^dt + \plDdW (t) — > 
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d t p = DAp- V • (p b ). 

In the hydrodynamical picture, we infer the closed system of two (special to Markovian 
diffusions !) local conservation laws in the form appropriate for the Smoluchowski process, 
(remember about specific functional forms of Q and Q): 

d t p+V-{!?p) = (17) 
(d t +v>-V)l? = V(fl-Q) (18) 



3.2 Free random dynamics with no friction 



Now 



dx 
' dt 



u and — A (t), hence: 



?L +u ?L = C(f)=q^L 
dt dx dv? 



We know [H] the transition density: 

p{x,u, t\ x , m , t = 0) = — — T exp 

2tt 2qt z 

By choosing an initial phase space density: 



(u-uof 3(x-x -^ty 



fo (x, u) 



27ra 2 



cxp 



1 "JC tjC J 



2a 2 



2ixb 2 



qt 3 



u — U,: 



exp 



2b 2 



(19) 



(20) 



(21) 



so that / (x, u,t) — f p(x,u, t\ x , u , t = 0) f (x , u ) dx du and passing to the hydro- 
dynamical picture (unpleasant steps), we observe that J C(f)du = and J uC(f)du = 
which yields the following outcomes, 

i 

POM) = I n 7 o . —n . 9 „\ I eX P 



p(u,t) 



2tt (a 2 + 6 2 t 2 + fgt 3 ) 
1 



2vr (6 2 + 2qt) 



exp 



2 (a 2 + b 2 t 2 + \qt 3 ) 

(u Uini) 



2 (b 2 + 2qt) 



b 2 t + qt 2 

\ U )x — U ini + a 2 _|_ fr2 t 2 _|_ 2^3 ^ ~~ ^ ~~ U * ni ^ ~~ V 

2 gt 3 (2 6 2 + gt) + 3a 2 (6 2 + 2gt) . P fcm 



V ^ V /x 3a 2 + t 2 {3b 2 + 2qt) 

This implies the local momentum conservation law: 
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-2 (d 2 ) V 



Ap 



1/2 



L P 



1/2 



-VQ 



with 



rf 2 (t) = a % 2 + 2a 2 qt + h 2 qt 3 + ~q 2 t 4 = D 2 {t) . 



(22) 

(23) 
(24) 
(25) 

(26) 
(27) 



Remember about: d 2 (t) = ((u 2 ) x — (u) 2 ) ((x 2 ) — (x) 2 ) and notice that d 2 (t) > a 2 b 2 
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3.3 Noiseless limit, C(f) = for all / 

Upon disregarding random forcing (set q — > in Eq. (19)), we arrive at: 

where clearly fC(f)du = = / uC(f)du = j u 2 C(f)du. 

Things now look classical and there is good reason for that, since Eq. (28) is the 
familiar Liouville equation. However this "classical look" appears slightly deceiving. 

Indeed, the q — > limit of the frictionless free dynamics gives rise to: 

"™< )= ^^{ JJt i£ l - lx ~ x zr taf i ■ (29) 

with marginals: 



and 



pM = ^M^r^yJ exp — 2 (fl ' + m 1 • (31) 



The local moments read: 

b 2 t 

V^)x ^ini ^2 _|_ Jj2^-2 ^ "^ini ^ini^) (32) 

and 

< u> >. - <«>: - < 33 > 

which yields the (local) momentum conservation law in the fairly nonclassical form: 

~Ap(x,t) 1/2 ~ 



p(x,t) 



1/2 



VQ (34) 



By setting a ■ b = ^ we recover the standard quantum mechanical "hydrodynamics", 
Eq. (7), to be compared with the Brownian variant of the law, Eq. (8). Notice that 
< x 2 > - < x > 2 = a 2 + b 2 t 2 and: 

aV = «„»>. - (u)l) «*»> - (,)») = JL (35) 

for all times. That is another expresssion for the standard quantum mechanical Heisenberg 
indeterminacy relation, see e.g. |16j-|19j. 

We recall that Q q = is the de Broglie - Bohm quantum potential. Is there 

anything specific or mysterious in its origin and physical meaning? 
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4 Miscellaneous contexts: Hamilton-Jacobi, Liouville, Kramers 
equations, calculus of variations 



Let us recall so-called wave equations of classical mechanics: 

d tP = -V ■ (p^) (36) 

lib 

with 

d t S + ^2 + V = o (37) 
2m 

Rename: — — > 5, set i> = VS, eventually take a gradient of the above Hamilton-Jacobi 
equation. Then, we have: 

d tP = -V • (vp) (38) 

and 

$v + (v ■ V)v = -W (39) 

Clearly, in the above there is nothing alike the VQ contribution, so characteristic to 
our previous dynamical examples, cf. Eqs. (7)-(9), (11), (12), (18), (26). What is the 
primary reason of so conspicuous absence of that term in Eq. (39) ? 

To set a connection with the Liouville equation we follow a standard assumption, pH] : 
assign a unique momentum value at each space point and consider phase-space densities 
as generalized functions 

fo(x, P) = Po{x)S( P - VS (x)) — > f{x, p.t) = p(x, t)5(p - VS(x, t)) (40) 

which (weakly) solve 

dJ +u dl + Fdl_ Q (41) 
dt dx m du 

In view of the fact that the Liouville equation preserves in time the precise knowledge 
of initial data, we have: 

fo(x,p) = 5(x-x )5(p-p ) -> f(x,p,t) = S(x - x(t,x ,po))6(p-p(t,x ,po)) (42) 

to be compared with the density function, Eq. (29). 

As a side remark, let us notice that the Hamilton-Jacobi equation can be derived via 
the least action principle by employing the Lagrangian density 



C = p 



d t s + hvsf + - 

2 m 



(43) 



with p and S considered as canonically conjugate variables, [To] . 
Where has gone our VQ (and Q itself) ? 
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Let us come back to the previous q — > free motion case, Eqs. (21) and (29). For 
all times t > both spatial and velocity parts of the phase-space density are well be- 
haved functions (not Dirac deltas). Hence, and indispensable, crucial step has been there 
to admit from the beginning both the spatial and momentum (velocity) indeterminacy 
(spreading, unsharpness) . At time t = 0, we assign to each point x a "bunch" of possible 
(to be picked up at random from a given probability law) momenta - a Gaussian distri- 
bution of momenta at each spatial point and in addition we adopt a definite probability 
law for the position variable. As an immediate outcome, we get Eq.(34) i.e.: 
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VQ 



(44) 



where: +2a 2 b 2 



A.p(x,t) 



1/2 



p(x,t) 



1/2 



= Q. This is the gradient form of: 



d t S 



Q = 



which derives (via the standard variational calculus) from the Lagrangian density: 



C = p 



d t S + -(VS) 2 



u 

y 



(45) 



(46) 



to be compared with the previous "precise" (sharp) momentum variant in the absence of 
conservative forces: 



C = p 



d t s + Uvs) 



(47) 



Now we need to come back to Eqs. (l)-(5), where entangled relationships among Q, 
Fisher information and local (information) entropy production were established for the 
Brownian motion. 

In direct affinity with Eq. (46), we can develop the Hamiltonian formalism (p and S 
are canonically conjugate, D = ab), [20] which employs : 



H 



Tidx 



dx p 



2^ "4 



dx-p\{VSf 



2D 2 ■ F 



x 



(48 



We can now devise convincing arguments which relate the emergence of Fx and Q in 
the above with the a priori introduced and simultaneously valid spatial and momentum 
indeterminacy. To this end we shall discuss the position and velocity unsharpness issue 
from the two, looking diverse, perspectives. 

Concerning the spatial (position) indeterminacy, we need the existence of the Fx term 
in Eq. (48). From the properties of the Fisher information, ^01 E], there follows that Fx 
goes to infinity when the spatial probability density approaches the delta function (sharp 
localization) limit. (The same happens when the probability density is discontinuous or 
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vanishes over certain interval). Hence, the Hamiltonian (48) is properly defined only in 
case of the nonsingular, unsharp spatial localization. 

With regard to the velocity (momentum) unsharpness, let us invoke classic observations 
in the so-called quantum theory of motion (Bohm theory, Holland (1993)), where one 
argues as follows (notice a "subtle" difference if compared to our probabilistic arguments). 

Equations: d t p = —V(vp) where v = —VS and 



(49) 



where Q, 



(50) 



d t + -v-Vjv = -V(V + Q g ) 

-Q imply that the distribution function: 

f(x,p,t) =p(x,t)5\p-VS(x,t)} 

obeys the law of evolution: 

d t f + -- V,/ + V X (V + Q q ) ■ V p f = . (51) 
m 

This equation reduces to the classical Liouville one only when Q q = 0, while the 
whole body of our previous discussion has explicitly referred to the Liouville equation as 
a primary building block of the theory. Consequently, in this context, a possibility that p 
(respectively u) can be sharply defined at each spatial point is definitely excluded, even 
if the spatial contribution is a priori assumed to be unsharp. 

Comment: For comparison with the previous random motion discussion, one should 
realize that the continuity (and thus Fokker- Planck) equation plus the Hamilton- Jacobi 
type equation of the general form (we formally use V/m instead of more correct Q): 



d t S+-{VS) 2 ±{Q-Q) = 



referring to the local conservation law: 

d 



Of 



both derive via the calculus of variations from, fH\ \'2'2\ : 



Cdx 



The related Hamiltonian reads: 



d t S + -(VS) 2 ± 



u 

Y 



n 



dx 



H 



Tidx 



dx p ■ 



n 



All that refers exclusively to the general phase-space equation: 

C(f) 

111 uu 

and not to any equation of the form (51). 



dt dx m du 



(52) 



(53) 



(54) 



(55) 



(56) 
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5 Supplement: variational arguments in the theory of the Brow- 
nian motion 



In connection with formulas (l)-(5) it is instructive to recall that in the Lagrangian 
formulation of the theory of random motion |2Hj the maximum rate of the information 
entropy increase has been found to maximize the Fisher information. After suitable 
notation adjustments, we realize that in Ref. [23] it is exactly —Fx that is minimized to 
yield the free spatial Brownian motion. 

In the very same case, [21], the relationship (cf. Eq. (4) for comparison): 



< X 2 >< u(X,t) 2 >= D 



(57) 



was established for the heat kernel solution of dtp = DAp, provided there holds < X >= 
=< u(X, t) >. For more general solutions of the heat equation for which the mean values 
of X(t) and u(X(t),t) do vanish, one arrives at a general indeterminacy relationship with 
an obvious affinity to the previously mentioned Cramer-Rao inequality: 



< x l >< u(x,ty >-- 







1/2 




1/2 


>= 


D 2 fdx-- (Vp) 2 




J dxx 2 ■ p 


> D 




. J P 







(58) 



Quite in parallel, a bit more general case was addressed in Ref. [IB], where a general 
(nonvanishing forward drift) one dimensional diffusion process with (time-dependent) dif- 
fusion coefficient D(t) was considered, under slightly weaker restrictions: < u(X,t) >= 
while < X >^ 0. The problem addressed, has been an issue of when the product of 
variances [< X 2 > — < X > 2 ] ■ [< u(X, t) 2 >} is minimized. 

The outcome is that a minimum is reached for a concrete product value equal D 2 (t) 
and that a necessary and sufficient condition for the probability density p(x, t) to yield 
that minimum, is that it has a Gaussian form: 



p(x,t) 



1 



• exp 



[x- 



<X>) 



2[< X 2 > - < X > 2 ]_ 



(59) 



(2tt) 1 /2[< X 2 > - < X > 2 ]i/2 

in agreement with our previous discussion. For nongaussian probability densities, an 
inequality of the type (58) holds true. 

Indeed, it is a classic observation, [T3j, that for a generic probability density p a (x,t) 
with the first moment J x ■ p(x,t)dx = f(a,t) and finite second moment, for which there 
exist both partial derivatives ^PaC-M) anc j 8 ^' t ) (f or a \\ a j n an interval in R 1 or generally 
in R l , and for almost all x G R 1 ), then we arrive at an inequality: 



[x — a) 2 p a (x, t)dx 



( dlnp a 
\ da 



p a (x, t)dx > 



df(a,t) 
da 



(60) 
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